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The 5-year timeline of data gathering activities 
































Visit 9 (AFAT): 1 day 

- Interviews 16, 17 & 18 

- 2 briefing-flight-debriefing sessions 

Visit 10 (AFAT): 1 day 

- Aerobatic flight (20 minutes) with an AFAT pilot 

- 2 hours of informal discussion with the 3 pilots 
in the squadron bar 


Visit 8 (AFAT): 3 days 

- Observation during the AFAT training week 

- 5 training flight exhibitions 

- 4 briefing-flight-debriefing sessions 

- 4 hours of informal discussion with pilots and 
mechanics in the squadron bar and during 
lunch 

Visit 5 (PAF): 1 day 

- 2 public PAF exhibitions 

- 2 training flight exhibitions 

- 1 hour of informal discussion with 2 pilots in 

their desk 


From May to September 


Visit 6 (AFAT): 3 days 

- Visit of the squadron, pilots’ desks and bar 

- Interviews 12, 13, 14,15, 19 &20 

- 4 briefing-flight-debriefing sessions 

-4 hours of informal discussion with the 
mechanics working on the aircrafts 

Visit 7 (AFAT): 2 days 

- Observations during the AFAT training week 

- 5 training flight exhibitions 

- 2 briefing-flight-debriefing sessions 

Interview 11 (PAF) 

3 public PAF exhibitions 


Visit 3 (PAF): 2 days 
- Visit of the squadron, pilots’ desks and bar 
- Interviews 5, 6,7&8 

- 2 briefing-flight-debriefing sessions 

- 2 training flight exhibitions 

- 1 hour of informal discussion at the bar 
Visit 4 (PAF): 1 day 

- Interviews 9 & 10 

- 1 briefing-flight-debriefing session 

- 1 training flight exhibitions 

- 2 hours of informal discussion at the bar 


From October to December 


Visit 1 (Fighter squadron): 3 days 

- Visit of the squadron buildings 

- Interviews 1 & 3 

- 1 briefing & 1 debriefing session 

Visit 2 (Fighter squadron): 1 day 

- Visit of the squadron buildings and bar 

- Interview 2 &4 

- 1 briefing session 

- 2 hours of informal discussion with the crew 
during lunch 
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Archival (Secondary) Data: Sources and Examples (2009-2016) 





Main sources 


Examples 





Air Command and Staff College 


https://www.airuniversity.af.edu/Portals/10/ASPJ/journals/Chronicles/brence1.p 
df 





























sessions) 

















suueary Centre de Recherche de |’Ecole de|Le maintien des compétences des équipages Transall et leur transfert vers les 
Technical sue Boa as 
Rodecad P Air équipages A400M, 07/2010 
aailieaahe DoD Archives https://archive.defense.gov/news/newsarticle.aspx?id=64661 
Rand Army Research Division and | https://www.rand.org/content/dam/rand/pubs/monographs/2005/RAND_MG267 
Rand Project Air Force -l pdf 
‘ https://www.nancydixonblog.com/201 1/02/a-model-lessons-learned-system-the- 
Conversation Matters 
us-army.html 
rom thé Green Notebook https://fromthegreennotebook.com/2013/09/18/the-friday-safety-brief-must-go/ 
Mnitary ploes https://smallwarsjournal.com/blog/understanding-the-human-terrain-key-to- 
Small Wars Journal ; ; 
success-in-afghanistan 
Task & Purpose https://taskandpurpose.com/community/5-ways-not-bore-troops-death- 
powerpoint 
Video AFAT website https://vimeo.com/106614734 
documentarie | PAF website https://vimeo.com/69970220 
s (AFAT, PAF | You Tube https://www.youtube.com/watch?v=zgM7M4 YIrGM 
and fighter https://www.youtube.com/watch?v>MMTRHeRRgXE 
aircrafts flights https://www.youtube.com/watch?v=TqoqY5rVUUc 
and feedback 
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Dimensions, themes and categories Representative data 
Aggregate dimension - Transition: Briefing 


1. Information shared 


What: To remember? To know? To expect? 
A. Briefing: "Review from previous flights"; Planning the 
today's flights 


B. "The domestics"; "What we need to know for achieving 
the mission?" 


C. "What if?": "What could happen and what solutions?" 
Prevalent feedback practice 


Reflexivity and technique 
D. "The music" 


E. "Think of that, be careful to that";"Flights are highly 
technical" 


Prevalent sources of feedback 

Coaches & peers, self, systems 

F. "As the team leader, I conduct the briefing"; Participants 
provide inputs 


G. Procedures and documentation: Aresti and NATO codes, 
"The bible" 


A.1. "We process recurring issues from our previous flights, to find solution before getting to the 
plane" (Interview 9) 

A.2. "During the briefing, we prepare together with precision our pending air show" (Interview 14) 
B.1. "The tactic of the day in relation to the priority threat is presented" (Interview 2) 

B.2. "We quickly brief the 'domestics' that is usual information, that don't change much day after 
day" (Interview 6) 

C.1. "We imagine what could happen in flight and we elaborate solutions" (Interview 4) 

C.2. "What if the target is not where it should be, if we have to conduct an air-to-air combat, if we 
have to deal with a system failure, etc." (Interview 2) 


D.1. "Some pilots mimic their coming flight through simple gestures representing the plane and 
pilot's movements in the air" (Interview 14) 

D.2. "This mental music is necessary as it helps me to remind myself what I will have to do well 
during the show" (Interview 7) 

E.1. "The briefing session is also there to remind us that we need to remain vigilant. Lessons 
learned yesterday or one month ago can be useful today" (Interview 7) 

E.2. "Flight safety, it's very strict procedures both for pilots and mechanics, and they are 
systematically recalled during briefing" (Interview 20) 


F.1. The patrol leader, PAF team leader or AFAT coach leads the briefing, explains goals to achieve 
and share technical information (Direct and indirect observations, archival data) 

F.2. "Before the end of the briefing session, we can take the floor: 'I want to raise a last point of 
order’; 'For the record, we must remember this or that point’, etc." (Interview 7) 


G.1. "We have what we call "the bible". The bible is a (now digital) book, in which all the figures 
we performed at the PAF are listed" (Interview 6) 


G.2. The aresti code: "Each figure starts at the small solid circle and ends at the vertical bar. All of 
the aerobatic figures start and end with horizontal lines in either upright or inverted flight. Solid 





lines describe upright flight, and dashed lines describe inverted flight" (Archival data) 


Dimensions, themes and categories Representative data 


4. Team processes 


Interpersonal 
H. The leader motivates military staff to be committed to —_-H.1. Reports, blogs and comments about how commanders can motivate their troops/teams during 
the mission briefing: What kind of messages, what kind of slides, etc. (Archival data) 
H.2. "I adapt the way I pass on information to move them forward" (Interview 19) 
I. "Yesterday was a good day!" I.1. "They shot their targets yesterday. It's good! We can see that they made progress" (Interview 4) 


1.2. "Last time, we reached our goals. Today, we will do better" (Interview 18) 
Aggregate dimension - Action: Team task performance (TTP) 
5. Information shared 

What: Is happening? To do immediately? 

J. TTP: "Fully involved in action"; "Dissemination of J.1. Between us [the pilot and the navigator], we call this immediate review ‘in flight debriefing" 

lessons learned is pretty straightforward" (Interview 2) 
J.2. "We perform short flights that last approximately 15 minutes, and the feedback is made and 
implemented as we fly" (Interview 13) 

K. "What is not going well?";"I do what I have to do" K.1. "Sometimes the team can be stuck in a tunneling-effect. They are so concentrated that they 
miss important things! Here, I take part and I speak to them on the radio: be careful, we are missing 
important levels of safety, get back on your feet!" (Interview 6) 
K.2. Scrutinizing the flight of one of the AFAT pilot, the coach suddenly freezes up. He gets the 
radio and screams: "you’re going to lose consciousness! You give too much, slow down now!" The 
pilot immediately follows the instructions, but the coach loose radio contact for 4 seconds: 
"blackout," he says, "he [the pilot] fixed the problem well; it could have been much more serious..." 
(Visit 8: Field notes from direct observations and audio-recording) 

6. Prevalent feedback practice 

Technique 

L. "Oral tradition" for passing on technical information L.1. "Technical know-how, you cannot find it in a workbook! You just have to live it and pass on it 
verbally. [...] Here, we don’t talk about theoretical knowledge. We talk about feelings, ‘steering 
buttocks’ as we’re used to saying” (Interview 12) 
L.2. "On the radio, I repeat 4 or 5 times the same advice during the flight so that the correction I 
want becomes automatic for the pilot" (Interview 19) 

M. Combination of "standardized" and "natural languages" M.1. "Code words are highly standardized. They are a common language that each military pilot 
understands" (Interview 2) 
M.2. "The language of aerial combat is quite intuitive. We adopt a natural language between us [the 
pilot and navigator] in the heat of the action" (Interview 1) 








Dimensions, themes and categories Representative data 


7. Prevalent sources of feedback 

Coaches & peers, systems 

N. "We need his [the coach] voice" N.1. "We need him to severely criticize what we are doing, and all this in real time" (Interview 13) 
N.2. "I provide the patrol with my experienced view on how they are performing the show" 
(Interview 6) 

O. "The aircrat provides us with a lot of information in real O.1. "Last year, when we arrived in Afghanistan, we had this georeferenced map in the cockpit, just 

time" perfect! (Interview 1) 
O.2. Buffeting effects [vibrations of the aircraft structure] are very strong: there is no doubt that the 
aircraft is stalling (Visit 10: Direct observations) 

Team processes 

Interpersonal 

P. "His comments come at the right time, to push ourselves" P.1. "I'm pulling them [team members] forward, it's my job as the word champion. [...] That means 
providing them with feedback: I look at the way they fly, especially those who are in trouble, and I 
help them in giving advices based on my experience" (Interview 14) 
P.2. "He motivates his back seat [navigator], encouraging communication" (Interview 3) 

Q. "Stress regulation" Q.1. "Talk with the FAC is a critical stage during CAS [Close Air Support]. He provides us with 
the target coordinates but he is also very attentive to our stress level, making sure that we well 
understand everything" (Interview 2) 
Q.2. The AFAT pilots fly under high pressure due to the complexity and extremely demanding 
figures they operate. Their coach is aware of this pressure and takes it into account during the team- 
task performance (Visits 7 and 8: Direct observations) 


Aggregate dimension - Transition: Formal debriefing 
9. Information shared 
What: Happened during performance? Outcomes were 
observed? To do next time? 


R. Debriefing: "Lessons learned from past action and errors R.1. "We reflect upon the flight and scrutinize the mistakes he [the pilot] made" (Interview 19) 


inspection" R.2. "He [the pilot] lands and right after, during debriefing, we discuss on what was wrong" 
(interview 17) 
S. "What led us to such a situation?"; "Is the result obtained S.1. "We always take time to reflect upon our previous flight: Did we make some mistakes? Have 


the one expected or not?"; "What are the lessons learned?" Some messages been misunderstood?" (Interview 4) 
S.2. "We can slow down or speed up the mission restitution. We watch the planes trajectories and 





how they evolve relative to each other" (Interview 2) 


Dimensions, themes and categories Representative data 


10. Prevalent feedback practices 

Reflexivity and technique 

T. "Reflect upon from errors" T.1. "Criticisms can be serious during debriefing, with a focus on what have been done poorly" 
(Interview 19) 
T.2. "Recently, I filled up the aircraft while it was parked on a sloping floor. I thought it was full 
but it wasn’t, one liter was missing. It’s a serious mistake! And it was important for me to reflect 
upon such a mistake and to share it with my colleagues in order to never reproduce it" (Interview 
20) 

U. "Systematic" debriefing guide collectively performed U.1. "Debriefing sessions are quite formal but it’s interesting to follow a guide, to be sure that we 
don’t forget anything. In regular French Air Force squadrons, we learn to debrief that way. It’s 
something that we share, all together" (Interview 4) 
U.2. "We debrief each day between us, right after each flight. It’s part of the mission" (Interview 
11) 

11, Prevalent sources of feedback 

Coaches & peers, self, systems 

V. "Watching and listening to the others" V.1. "Feedback is achieved in looking at the way the other team members fly" (Interview 12) 
V.2. "I learned much in just watching and listening to him" (Interview 3) 

W. "Self-criticism" W.1. "During debriefings, each of us auto-debrief from the others' performance" (Interview 5) 
W.2. "How did we get to that situation? Here, I make my self-criticism and I examine all details of 
my flight" (Interview 7) 


X. Analytic tools and ressources for reviewing past actions X.1. "External and internal video are key media from which I capitalize knowledge and know-how" 
(Interview 15) 
X.2."We have what we call "the bible". The bible is a kind of book, in which all the figures we 
performed at the PAF are listed. We often use it. [...] The bible helps us to better understand this or 
that figure" (Interview 6) 


12. Team processes 
Interpersonal 
Y. "Results give us confidence in the future" Y.1. "We are world champions this year! It's a true source of emulation for retaining the trophy next 
year" (Interview 15) 
Y.2. "Success stories" can be reminded at the end of debriefing. They can deal with the 
team/squadron, but also more broadly with the military institution (Direct observation and archival 
data) 





Dimensions, themes and categories Representative data 


Z. "Being accountable" for his/her actions; "Transparency" Z.1. "He [the pilot] has to recognize that he's not engaged in proper movements, or that he develops 
unappropriated movements" (Interview 14) 
Z.2. "We debrief from the external video-recording: we freeze images, play in slow motion, etc. At 
first, the guy thinks he’s fine; but when we watch the video, he sees that he is in fact folded like a 
sausage when the others are in position; everybody sees it" (Interview 7) 


Aggregate dimension - Transition: Informal debriefing 
13. Information shared 
What: Else happened during performance ? To remember 
about individuals and the team? 
a. Informal debrifing: "Formal debriefing must be a.1. "We take advantage of more informal discussions [...] it’s a way for us to complete the formal 


wou 


supplemented by informal exchanges"; "open discussions" debriefing" (Interview 12) 
a.2. "Communication, exchanges between us, it's the key. We learn to speak frankly, in a 
constructive manner" (Interview 20) 

b. "We still discussing his problem at the bar, extensively, b.1. "At the bar, we go further. If some ambiguities remains, they must be cleared" (Interview 6) 

trying to help him" b.2. Two AFAT pilots talk to the pilot about his flight, pursuing his flight debriefing (Visit 6: 
Direct observations) 

c."Sometimes we need to talk about the way we work as a__c.1. "We always talk about the way we work together, as an aircrew" (Interview 1) 

team" c.2. "We got a lot of flak! But it's helpful. The purpose is collective improvement to be able to 
achieve an aesthetic and secure show all together" (Interview 11) 

14, Prevalent feedback 

Socialization 

d. "We relax, we laugh a lot, we get to know each other" d.1. "We have time to just relax, to share more than aerobatics and meetings, talk rubbish, etc. It’s a 
way to create team spirit" (Interview 7) 
d.2." these moments help us to know each other beyond our technical capabilities and expertise. 
They allow us to take a different approach, understanding attitudes and deepening social ties 
personalities, " (Interview 12) 


e. "Collective knowledge for trust building" e.1. "We learn to know each other during these informal and friendly moments. That's help us to 
build cohesion and trust each other, our links are very closed" (Interview 5) 


e.2. "We work, we debrief, we fly, we meet up later... In fact, we progressively build collective 
knowledge, that help us to go further. We are almost a family!" (Interview 16) 





Dimensions, themes and categories Representative data 


15, Prevalent sources of feedback 

Coaches & peers, environment 

f. Others pilots explain that they made the same mistakes _f.1. "There are situations that we've already been through before and we share our experience with 
younger pilots" (Interview 14) 
f.2. "When I have a doubt or when I'm doing something wrong in flight, I ask to "the olds" [pilots 
with few years of experience as team members]: 'Did you make the same mistake? What is the 
solution?" (Interview 11) 

g. "There's a good team atmosphere and people show g.1. "We are all united around the mission, and there is a very pleasant climate between us" 


respect for each other" (Interview 11) 
g.2. "The atmosphere is good, we feel closer from each other, and that makes informal exchanges 


easier" (Interview 16) 
16. Team processes 
Interpersonal 
h. "We solve many problems and conflict between people at h.1. "The privileged place to exchange is the squadron bar. Usually, everybody meets at the 
the bar!" squadron bar at some point in the day" (Interview 18) 
h.2. "We give explanations when we go through rough moments or when we disagree. Our goal is: 
no unsaid things" (Interview 9) 


i. Extra-professional activities for cohesion building i.1. "As the AFAT manager, I organized a ski week a few months ago. I managed to have identical 
outfits, for all of us. We really felt as a team as we displayed for all to see. It was a very cohesive 


week" (Interview 18) 
1.2. "Throughout the year, we are together: we do sports, we go to internship training, we fly, we 
meet in the morning and evening... That helps us to discover each other!" (Interview 11) 





